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METHOD AND APPARATUS FOR STREAMING XML CONTENT 



Field of the Invention 

The present invention relates to the streaming of 
5 continuous media, and more particularly, to a method and 
apparatus for streaming XML content. 

Background of the Invention 

The Extensible Markup Language (XML) is a standard for 

10 encoding textual information that has been recommended by the 
World Wide Web Consortium (W3C) . For a discussion of the XML 
standard, see, for example, Extensible Markup Language (XML) 1.0 
W3C Recommendation, http://www.w3.org/TR/1998/REC-xml-1998 0210, 
incorporated by reference herein. The XML standard allows XML- 

15 enabled applications to inter-operate with other compliant 
systems for the exchange of encoded information. 

XML documents store textual data in a hierarchical tree 
structure. Each XML document has one root node, often referred 
to as the root element, with the other nodes in the hierarchical 

20 tree being arranged as descendants of the root node. The XML 
standard specifies four types of nodes, namely, character nodes, 
processing instruction (PI) nodes, comment nodes and element 
nodes . A character node contains only one character . A 
processing instruction node contains a name field and a content 

25 field (a sequence of characters) . A comment node has only a 
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content filed (a sequence of characters) . Character nodes, 
processing instruction (PI) nodes and comment nodes are always 
leaf nodes in an XML document. Element nodes have children, a 
name (often referred to as a generic identifier (GI) ) , and a set 
5 of attributes (keyword- value pairs) . An XML-based application 
can store data in all the different types of nodes and in all the 
fields of each node type. 

A number of applications, such as video on demand and 
other continuous media applications, have emerged for encoding 

10 and transmitting continuous media streams. The proposed MPEG-7 
standard, for example, from the Motion Pictures Group, provides a 
specification for encoding video information as well as textual 
information related to the video source. Continuous media 
streams are typically transmitted using a packet-based 

15 comitiunication system. Due to the unreliable nature of packet- 
based communication systems, however, the quality of the received 
stream may be impacted by packet loss. Thus, such continuous 
media transmission systems generally must include a mechanism 
that allows the receiver to adapt to lost packets. A number of 

20 techniques have been proposed or suggested for addressing packet 
loss in a continuous media transmission system, including 
redundant transmissions, retransmission, interleaving and forward 
error correction techniques. For a general discussion of such 
techniques for addressing packet loss in continuous media 

25 systems, see, for example, "Options for Repair of Streaming 
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Media," Network Working Group, Request for Comments No. 2354 
(June, 1998), downloadable from ftp.isi.edu/in-notes/rfc2354.txt, 
incorporated by reference herein. 

XMLNet is an application programming interface (API) 
5 for streaming XML documents. XMLNet allows information to be 
transferred over the Internet or another network in real time as 
a series of XML documents. The XML documents are delivered to the 
receiver in a serial fashion. The receiver must receive an 
entire XML document, however, before the receiver can decode and 
10 process any of the XML content contained in the XML document. 
For a discussion of XMLNet, see, for example, "XMLNet," 
downloadable from home . earthlink.net/%7Earabbit/xmlnet (December 
9, 1998). 

A need therefore exists for a method and apparatus that 
15 allows a receiver to decode the portions of the XML encoded 
content that are actually received, even if portions of the 
complete XML document are not received, for example, in the event 
of a packet loss or before the complete XML document is received. 
A further need exists for a method and apparatus that permits 
20 streaming of XML content in a manner that allows the transmitted 
XML to be decoded by the receiver even if an entire XML document 
is not received. 
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Summary of the Invention 

Generally, a method and apparatus are disclosed for 
streaming XML content in a manner that allows the receiver to 
decode the XML data that is received even if an entire XML 
5 document is not received. An XML receiver may decode only a 
portion of the streamed XML content, for example, if part of the 
XML data is subject to a packet loss or if the complete XML 
document has not yet arrived. Thus, the present invention allows 
the XML receiver to begin processing an XML stream in mid- 
10 transmission. 

5 According to one aspect of the invention, each XML 

document is decomposed and encoded as a collection of sub-trees. 
Each sub-tree from the larger XML dociiment tree can be parsed and 
ff^ validated by the XML receiver as if it is an independent tree, 

t 15 According to another aspect of the invention, each sub-tree in 
O the streamed XML dociament utilizes a structure node that serves 

^=!f as a sub-tree wrapper function around each independent sub-tree. 

The structure node indicates the relationship of the sub-tree to 
other sub-trees, thereby allowing the XML receiver to reconstruct 
20 the full tree, provided enough of the streamed XML content is 
received. As used herein, a "structure node" is any node that 
identifies the content nodes included in a given sub-tree and 
indicates where the sub-tree is positioned within the larger XML 
document tree. 
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A more complete understanding of the present invention, 
as well as further features and advantages of the present 
invention, will be obtained by reference to the following 
detailed description and drawings. 

5 

Brief Description of the Drawings 

FIG. 1 illustrates a representative network environment 
where the present invention may operate; 

FIG. 2A illustrates a conventional hierarchical XML 
10 document tree; 

FIG. 2B illustrates a portion of the corresponding 
pseudo-code necessary to construct the hierarchical XML tree of 
FIG. 2A; 

FIG. 3 is a block diagram showing the architecture of 
15 an illustrative XML transmitter in accordance with the present 
invention; 

FIG. 4 is a block diagram showing the architecture of 
an illustrative XML receiver in accordance with the present 
invention; and 

20 FIG. 5 is a flow chart describing an exemplary streamed 

XML process executed by the XML receiver of FIG. 4. 

Detailed Description 

FIG. 1 illustrates a network environment 100 where the 
25 present invention may operate. As shown in FIG. 1, an XML 
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transmitter 300 transmits streamed XML content to an XML receiver 
400, According to a feature of the present invention, discussed 
further below, the XML transmitter 300 encodes and transmits the 
XML content in such a manner that allows the XML receiver 400 to 
5 decode the portions of the transmitted XML content that are 
actually received. For example, the XML receiver 400 may decode 
only a portion of the streamed XML content if part of the XML 
data is subject to a packet loss or if the complete XML document 
has not yet arrived. Thus, in accordance with the present 
10 invention, the XML receiver 400 can intercept an XML stream in 
mid-transmission and still perform useful tasks based on the 
received portion of the XML encoded data. In this manner, the 
receiver can be confident in the integrity of the received 
portion of the XML encoded content. 
15 According to another feature of the present invention, 

each XML document is encoded as a collection of sub-trees. Thus, 
the receiver 400 no longer needs to receive the entire XML tree. 
FIG. 2A illustrates an XML document tree 200, and FIG. 2B 
illustrates a portion of the corresponding pseudo-code 250 
20 necessary to construct the XML tree 200 of FIG. 2A. As shown in 
FIG. 2A, the XML document tree 200 includes a root node 205 and a 
number of sub-nodes 210, 220, 230, 240 and 245. 

As previously indicated, the XML tree 200 is decomposed 
and encoded as a collection of sub-trees. A siab-tree is said to 
25 be mounted on a given node, and contains the given node and ail 
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nodes beneath the given node in the hierarchical tree structure. 
For example, as shown in FIG. 2A, sub-tree 225 is mounted on node 
230 and contains nodes 230, 240 and 245. Each sub-tree, such as 
the sub-tree 225, in the larger XML document tree 200 can be 

5 parsed and validated by the receiver 400 as if it is an 
independent tree. It is noted that a given sub-tree can include 
additional sub-trees. 

According to another feature of the present invention, 
each sub-tree in the streamed XML document utilizes a structure 

10 node that serves as a sub-tree wrapper function around each 
independent sub-tree. The structure node indicates the 

relationship of the sub-tree to other sub-trees. In this manner, 
the XML receiver 400 can reconstruct the structure of the full 
tree 200 provided enough of the streamed XML content is received. 

15 Thus, the present invention utilizes structure nodes, in addition 
to the well-known XML content nodes. With reference to FIG. 2A, 
nodes 210, 220, 240 and 245 are content nodes, while the root 
node 2 05 and node 230 are structure nodes. In addition, the 
present invention modifies the XML provisions regarding Document 

20 Type Definitions (DTDs) to allow parts of the DTDs (DTD chunks) 
to be present with the sub-trees. The DTD chunks are used in 
accordance with the present invention to verify the validity of 
the sub-tree. In one variation, the DTD chunks are not included 
in the sub-trees, but rather, a reference is included to the full 

25 DTD. 
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Generally, document templates are utilized to parse the 
XML content for streamed transmission. One or more of the sub- 
nodes in the full XML tree 200 are treated as root nodes to 
establish the independent sub-trees. For example, the root node 

5 for sub- tree 225 in FIG. 2A is the node 230 upon which the sub- 
tree 225 is mounted. Each sub-tree has a structure node to allow 
the transmitted XML content to be reconstructed into the larger 
XML tree 200, if desired. The larger XML tree 200 can be 
decomposed into a collection of sub-trees in accordance with the 

10 requirements of a given user or application. For example, if the 
XML document tree 200 was decomposed to establish node C and 
everything below it as an independent sub-tree 225, the structure 
node for the sub-tree would indicate that content nodes D and E 
should be collected and attached to node C. 

15 Thus, as used herein, a "structure node" is any node 

that identifies the content nodes included in a given sub-tree 
and indicates where the sub-tree is positioned within the larger 
XML document tree 200. The structure node can identify the 
content nodes included in a given sub-tree by generally 

20 indicating that all previous content nodes since the previous 
structure node should be collected, or by providing a specified 
list of content nodes. 

FIG. 3 is a block diagram showing the architecture of 
an illustrative XML transmitter 300 in accordance with the 

25 present invention. The XML transmitter 300 may be embodied as a 
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general purpose computing system, such as the general purpose 
computing system shown in FIG. 3. As shown in FIG. 3, the XML 
transmitter 300 preferably includes a processor 310 and related 
memory, such as a data storage device 320, which may be 
distributed or local. The processor 310 may be embodied as a 
single processor, or a number of local or distributed processors 
operating in parallel. The data storage device 320 and/or a read 
only memory (ROM) (not shown) are operable to store one or more 
instructions, which the processor 310 is operable to retrieve, 
interpret and execute. 

The data storage device 320 includes a text source 350 
that may be retrieved from memory or generated in real-time. 
Thus, the text source 350 may be a pre-recorded textual file, 
such as a database or another document, or a document generated 
in real-time, for example, by a user entering textual information 
from a keyboard (not shown) or by a speech recognition system 
(not shown) . The data storage device 320 also includes one or 
more XML templates 360 that indicates how the textual information 
should be decomposed in constructing the XML tree 200, and the 
independent sub-trees. Thus, the XML transmitter 300 will 
process the text source 350 using the identified XML template 360 
to generate the transmitted content in a streamed XML format, in 
accordance with the present invention. As previously indicated, 
each transmitted sub-tree, such as the sub-tree 225, will include 
one or more content nodes and at least one structure node 
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indicating how the sub-tree is positioned in the complete XML 
tree 200. 

FIG. 4 is a block diagram showing the architecture of 
an illustrative XML receiver 400 in accordance with the present 
5 invention. The XML receiver 400 may be embodied as a general 
purpose computing system, such as the general purpose computing 
system shown in FIG. 4, or the XML receiver 400 may be integrated 
with another device, such as a digital television (DTV) . The XML 
receiver 400 includes certain standard hardware, such as 
10 processor 410 and related memory, such as a data storage device 
420, as discussed above in conjunction with the XML transmitter 
300 (FIG. 3) . 

The data storage device 420 includes a streamed XML 
process 500, discussed below in conjunction with FIG. 5. 

15 Generally, the streamed XML process 500 processes each node that 
is actually received from the XML transmitter 300, even if 
portions of the larger XML document are not received. In 
accordance with the present invention, the streamed XML process 
500 utilizes the structure nodes to collect the content nodes and 

20 subsequently rebuild the full XML document tree 200. Thus, the 
data storage device 420 also includes storage for the received 
content nodes 450 that are associated with a current XML tree 2 00 
that is being received by the XML receiver 400. 

FIG. 5 is a flow chart describing an exemplary streamed 

25 XML process 500 executed by the XML receiver 400 of FIG. 4. The 
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streamed XML process 500 processes each node that is actually 
received from the XML transmitter 300, even if some of the nodes 
are not received or are received in a corrupted manner. Any 
nodes that are received in a corrupted manner are not processed 
5 by the XML receiver 400 • It is noted that the present invention 
provides a method and apparatus for processing the nodes that are 
actually received by the XML receiver 400, even if some nodes are 
lost. Techniques for recovering the nodes that are not received 
or are received in a corrupted manner are not within the scope of 

10 the present invention. 

As shown in FIG. 5, the streamed XML process 500 
initially performs a test during step 510 to determine if a 
received node is a content node or a structure node. If it is 
determined during step 510 that a received node is a content 

15 node, then the content node is processed directly during step 
520, for example, by displaying the content or storing the 
content in a specified location. If, however, it is determined 
during step 510 that a received node is a structure node, then 
the structure node is evaluated during step 530 and the 

20 identified content nodes are assembled to form the current sub- 
tree, and to position the sub-tree in the full XML dociament 200 
under construction. 

Thereafter, a test is performed during step 540 to 
determine if additional nodes have been received that are 

25 associated with the current sub-tree. If it is determined during 
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step 540 that there are additional nodes in the current sub-tree 
to be processed, then program control returns to step 510 and 
continues processing the next node in the manner described above. 
If, however, it is determined during step 540 that there are no 
additional nodes in the current sub-tree to be processed, then a 
further test is performed during step 550 to determine if an 
additional sub-tree has been received that is associated with the 
current XML tree 200. 

If it is determined during step 550 that there is 
additional sub-tree to be processed in the current XML tree 200 
being constructed, then program control returns to step 510 and 
continues processing the next sub-tree in the manner described 
above. If, however, it is determined during step 550 that there 
are no additional sub-trees to be processed in the current XML 
tree 200 being constructed, then the full XML tree 200 can be 
assembled during step 560. Thereafter, program control 

terminates during step 570 until additional nodes are received 

for processing. 

It is to be understood that the embodiments and 
variations shown and described herein are merely illustrative of 
the principles of this invention and that various modifications 
may be implemented by those skilled in the art without departing 
from the scope and spirit of the invention. 
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Claims 



What is claimed is: 

5 1. A method of encoding XML content, comprising the steps 

of: 

generating content nodes for transmitting content 

information; and 

generating at least one structure node for identifying 
10 said content nodes and for indicating where said content nodes 
are positioned within a larger XML document tree. 

2. The method of claim 1, wherein said content nodes and 
said structure nodes are generated in accordance with a specified 

15 document template. 

3. The method of claim 1, wherein said structure node 
includes a list of said content nodes. 

20 4. The method of claim 1, wherein said XML content is 

generated in real-time by a Tfser operating a textual input 
device . 

5. The method of claim 1, wherein said XML content is 

25 generated in real-time by a speech recognition system. 
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6. A method of encoding an XML document, said XML document 
comprised of a plurality of nodes, said method comprising the 

. steps of: 

5 decomposing said XML document into a plurality of sub- 

trees, each of said sub-trees including at least one node; and 

independently transmitting each of said sub-trees with 
information indicating how said sub-tree is positioned within 
said larger XML document. 

10 

7. The method of claim 6, wherein said decomposing step is 
performed in accordance with a specified document template. 

8. The method of claim 6, wherein said information 
15 indicating how said sub-tree is positioned within said larger XML 

document is transmitted in a structure node, 

9. The method of claim 6, wherein said XML document is 
generated in real-time by a user operating a textual input 

20 device. 

10. The method of claim 6, wherein said XML document is 
generated in real-time by a speech recognition system. 
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11, A method for transmitting an XML document as a 
continuous stream, comprising the steps of: 

decomposing said XML document into a plurality of sub- 

• trees; 

5 generating content nodes for transmitting content 

information included in said XML document; and 

generating at least one structure node for each of said^ 
sub-trees, said structure nodes identifying content nodes 
included in said corresponding sub-tree and indicating where said 
10 sub-tree is positioned within said larger XML document. 

12, The method of claim 11, wherein said decomposing step 
is performed in accordance witja-a specified document template, 

15 13, The method of claim 11, wherein said structure node 

includes a list of said content ngdres. 

14, The method of claim 11, wherein said XML content is 
generated in real-time by a us'er operating a textual input 

20 device. 

15. The method of claim 11, wherein said XML content is 
generated in real-time by a speecTlT recognition system. 
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16 • A method for receiving a streamed XML document, said 

XML document including content nodes and structure nodes, said 

method comprising the steps of: 

determining if each received node is a content node or 
5 a structure node; 

processing said content nodes directly; and 
recompiling said XML document from said content nodes 

using information contained in said structure node» 

10 17. The method of claim 16^ wherein said processing step 

further comprises the step of displaying said content. 

18. The method of claim 16, wherein said processing step 
further comprises the step of staring said content. 

15 

19. The method of claim 16, further comprising the step of 
continuing to process subsequen£^ nodes even if one of said nodes 
is not properly received. 

20 20. A method of decoding a received XML document, said JfML 

document comprised of a plurality of nodes, said method 
comprising the steps of: 

receiving a plurality of XML sub-trees, each of said 
sub-trees including at least one node and indicating how said 

25 sub-tree is positioned within said larger XML document; and 
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positioning each of said sub-trees in a larger XML 
document using said received position indication • 



21. The method of claim 20, wherein said processing step 
5 further comprises the step of displaying said content. 

22. The method of claim 20, wherein said processing step 
further comprises the step of storing said content. 

10 23. An XML transmitter comprising: 

a memory for storing XML content and computer readable 

code; and 

a processor operatively coupled to said memory^r said 
processor configured to: 
15 generate content nodes for transmitting content 

information; and 

generate at least one structure node for identifying 
said content nodes and for indicating where said content nodes 
are positioned within a larger XML document tree. 

20 

24. An XML transmitter comprising: 

a memory for storing XML content and computer readable 

code; and 

a processor operatively coupled to said memory, said 
25 processor configured to: 
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decompose said XML document into a plurality of sub- 
trees, each of said sub-trees including at least one node; and 

independently transmit each of said sub-trees with 
information indicating how said sub-tree is positioned within 
5 said larger XML document. 

25. An XML transmitter comprising: 

a memory for storing XML content and computer readable 

code; and 

10 a processor operatively coupled to said memory, said 

processor configured to: 

decompose said XML document into a plurality of sub- 
trees; 

generate content nodes for transmitting content 
15 information included in said XML document; and 

generate at least one structure node for each of said 
sub-trees, said structure nodes identifying content nodes 
included in said corresponding sub-tree and indicating where said 
sub-tree is positioned within said larger XML document. 

20 

26. An XML receiver for receiving a streamed XML document, 
said XML document including content nodes and structure nodes, 
comprising: 

a memory for storing computer readable code; and 
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a processor operatively coupled to said memory, said 
processor configured to: 

determine if each received node is a content node or a 
structure node; 
5 process said content nodes directly; and 

recompile said XML document from said content nodes 
using information contained in said structure node* 

27. An XML receiver for receiving a streamed XML document, 

10 said XML document including content nodes and structure nodes, 
comprising: 

a memory for storing computer readable code; and 
a processor operatively coupled to said memory, said 
processor configured to: 
15 receive a plurality of XML sub-trees, each of said sub- 

trees including at least one node and indicating how said sub- 
tree is positioned within said larger XML document; and 

position each of said sub-trees in a larger XML 
document using said received position indication, 

20 



25 
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ABSTRACT 



A method and apparatus are disclosed for streaming XML 
content in a manner that allows the receiver to decode the XML 
data that is actually received, even if an entire XML document is 
not received. Each XML document is decomposed and encoded as a 
collection of sub-trees. Each sub-tree from the larger XML 
document tree can be parsed and validated by the XML receiver as 
if it is an independent tree. Each streamed XML document 
utilizes a structure node that serves as a sub-tree wrapper 
function around each independent sub-tree. The structure node 
indicates the relationship of the sub-tree to other sub-trees, 
thereby allowing the XML receiver to reconstruct the full tree. 
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appHcation in the manner provided by the first paragraph of Title 35 United Stats$ Code, 12, 1 acknowledge the duty 
to disclose mMerial Informauon as defined m Title 37, Code of Federal Reguktions, ^1 ,56(a) which occurred between 
the filing date of the prior spplicadon and die national or PCT international filing date of this appiication: 



PRIOR UMTED STATES APPLICaTIQN(5) 

■ ■ " '■■ ■ '■ — - 





APPLICATION SERIAL 


FliiNODATE 


STATUS (PATENTED, PENDING, 




NUMBER 




ABANDONED) 











I hereby declare that all siatements made herein of my own knowledge are true and that all statements naade on 
informatjon and belief are believed to be mae; and fauther that these statemeii{s were made with rhe knowled£e that 
willful false statements and the Ulce $o made arc punishable by fine or imprisomnent, or both, under Secd<?n lOOJ of Title 
18 of the United States Code and that such wllfui false statements may jeopardise the validity of the application or any 
patent issued thereon. 

POWER OF ATTORNEY; As a named inventor, i hereby appoint die following stton2ey(5) and/or agent(s) to 
prosecate this application and transact all business in the Patent and Trademark Oiflce connected therewith, (lis; came 
arid registration nuinber) 
Algy Tamoshunas, Reg. Nc. 27,677 

lackE, Hakcn, Reg. No. 26.902 



SEND CORRESPONDENCE TO: 
Corporate Patent Counsel; 
U.S. Philips Corporation; 580 White Plains Road; 
Tarrytown^NY 10591 



DIRECT TELEPHONE CALLS TO; 
Gregory L. Thome 
(914)333-9665 
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Dated: 

Oct 


Inventor's Signature: 


Full Nfiiine 
of 

Inventor 


Last Name: 

Krasinski 


First Name : 
Raymond 


Middle Name: 

J. i 


Residence 

& 

Citizenship 


City 

Suffem 


State or Foreign Conntry 

New York 


Conntry of CitizensMp j 
United States of America [ 


Post 

Office 

Address 


Street 

5 Reigate place 


City 

SuffexTi 


Stata or Country 
New York 


Zip Code 

!090J 




Dated; 


Inventor's Signature: 


Full Name 
of 

Inventor 


Last Name: 


First Name: 


Middle Name; 


Residence 
& 

Citi^nship 


City 


State or Foreign Country 


Country of Citizenship 


Post 

Office 

Address 


Street 


City 


State or Country 


Zip Code 
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TOTPL P. 04 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re Application of Atty. Docket 

RAYMOND J. KRASINSKI PHA 23,789 

Serial No. 
Filed: CONCURRENTLY 

Title: METHOD AND APPARATUS FOR STREAMING XML CONTENT 

Coituctiissioner of Patents and Trademarks 
Washington, D.C. 20231 

APPOINTMENT OF ASSOCIATES 

Sir: 

The undersigned Attorney of Record hereby revokes all 
prior appointments (if any) of Associate Attorney (s) or Agent (s) in 
the above-captioned case and appoints: 

GREGORY L. THORNE (Registration No. 39,398) 

c/o U.S. PHILIPS CORPORATION, Intellectual Property Department, 580 
White Plains Road, Tarrytown, New York 10591, his Associate 
Attorney (s) /Agent (s) with all the usual powers to prosecute the 
above-identified application and any division or continuation 
thereof, to make alterations and amendments therein, and to 
transact all business in the Patent and Trademark Office connected 
therewith . 

ALL CORRESPONDENCE CONCERNING THIS APPLICATION AND THE 
LETTERS PATENT WHEN GRANTED SHOULD BE ADDRESSED TO THE UNDERSIGNED 
ATTORNEY OF RECORD. 



Respectful 





k E. Haken, Reg, 
torney of Record 



6,902 



Dated at Tarrytown, New York 
this 29^^ day of September, 1999. 
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